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Abstract 

The ray-based 4D light field representation cannot be 
directly used to analyze diffractive or phase-sensitive op- 
tical elements. In this paper, we exploit tools from wave 
optics and extend the light field representation via a novel 
"light field transform ". We introduce a key modification 
to the ray-based model to support the transform. We in- 
sert a "virtual light source ", with potentially negative val- 
ued radiance for certain emitted rays. We create a look- 
up table of light field transformers of canonical optical el- 
ements. The two key conclusions are that (i) in free space, 
the 4D light field completely represents wavefront propa- 
gation via rays with real (positive as well as negative) val- 
ued radiance and (ii) at occluders, a light field composed 
of light field transformers plus insertion of (ray-based) vir- 
tual light sources represents resultant phase and amplitude 
of wavefronts. For free-space propagation, we analyze dif- 
ferent wavefronts and coherence possibilities. For occlud- 
ers, we show that the light field transform is simply based 
on a convolution followed by a multiplication operation. 
This formulation brings powerful concepts from wave op- 
tics to computer vision and graphics. We show applications 
in cubic-phase plate imaging and holographic displays. 



1. Introduction 
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Figure 1: (Top) Wavefront, WDF, and LF representation of 
a point source. (Middle) The WDF representation and (Bot- 
tom) The LF representation of wavefront at and after prop- 
agation in Young's experiment. In the WDF representation, 
we see that an additional oscillatory term is introduced at 
the midpoint of the two point sources, which produces in- 
terference after propagation. 



The light field (LF) is a four-variable parameterization 
of the plenoptic function [29, 23] describing the radiance 
of a ray propagating along 9 X and 6 y directions at x and 
y. The ray-based 4D LF representation is based on sim- 
ple 3D geometric principles and has led to a range of new 
algorithms and applications. They include digital refocus- 
ing, depth estimation, synthetic aperture, and glare reduc- 
tion. However, the LF representation is inadequate to de- 
scribe interactions with diffractive or phase-sensitive op- 



tical elements (i.e., phase masks or holography). In such 
cases, Fourier optics principles are often used to represent 
wavefronts with additional phase information. It is known 
that the Wigner distribution function (WDF) is a counter- 
part of the LF in wave optics. The WDF describes the local 
spatial frequency spectrum of light, where the local spatial 
frequency u corresponds to the ray angle 9. Figure 1 rep- 
resents an important observation. In some cases, e.g., for a 
point object, the WDF and the LF exhibit identical proper- 
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Figure 2: The augmented LF transformer concept. (Top) 
In free space, we make WDF and LF equivalent (via nega- 
tive radiance values). (Bottom) At thin optical element, we 
show that a LF transformer performs multiplication in the 
spatial domain and convolution in the angular domain. 

ties. However, in other cases, e.g., in Young's experiment, 
the WDF and LF differ at occluders as well as after finite 
propagation. 

In this paper, we exploit relevant tools in wave optics 
and present an augmented LF framework to handle diffrac- 
tion and phase-sensitive imaging. Figure 2 summarizes the 
key idea. We develop a simple toolbox to explain LF prop- 
agation through such materials. We introduce a notion of 
virtual light sources, for which the radiance of a ray is real 
(positive as well as negative) valued. We show that the aug- 
mented LF representation is sufficient to describe general 
wavefront propagation. 

For simplicity, we explain the light propagation in flat 
land (i.e., in the plane of the paper). In the flat land the LF 
and WDF are 2D functions. The same analysis applies to 
the real 3D world, where the LF and WDF are 4D functions. 

1.1. Contribution 

For a more comprehensive LF analysis, we adapt useful 
tools from wave optics and present an augmented LF prop- 
agation framework. Specific technical contributions are as 
follows: 

• We derive new LF propagation (for free-space) & 
transformation (for occluders) equations that are as 
powerful as traditional wave-optics techniques. 

• We observe the following two facts: i) In free-space 
propagation, the WDF and LF are equivalent for any 
coherence state, ii) For interaction with thin elements 




Figure 3: Comparison of the LF, ALF, and WDF. The LF 
formulation lacks phase properties and its radiance is al- 
ways positive, whereas the ALF supports partially coherent 
light and diffractions by introducing the LF transformers 
and virtual light sources. 



in the optical path, transforms of incident LF plus vir- 
tual light sources produce an exact solution for the re- 
sultant LF. 

• We show applications of the formulation in devices for 
which LF analysis has not been used before, such as in- 
terferometers, phase plates, and holographic displays. 

We hope to inspire researchers comfortable with ray-based 
analysis to start exploiting more complex optical elements. 
They can use well-understood LF concepts plus the new 
ray-based tools we have introduced, without worrying 
about complex Fourier-domain calculus common in wave- 
optics. 

1.2. Scope and limitation 

Since we intend to model diffraction and phase-related 
optical phenomena, coherence of light should be properly 
treated. Conceptually, coherence indicates the ability of 
making interference. Coherent light, e.g., a wavefront from 
a laser, has deterministic phase relations over all wave- 
fronts, whereas incoherent light has completely random 
phase relations. Partially coherent state refers to any coher- 
ence state in between completely coherent and incoherent 
ones. The spatial frequency spectrum of incoherent light is 
extended to the evanescent cut-off in principle; the prop- 
agation direction is not well defined or equivalently inco- 
herent light propagates along all directions. Hence, inco- 
herent light may be regarded to be superposition of infinite 
numbers of plane waves with random phase delays. Al- 
though the WDF can be defined for partially coherent light, 
our formulations and representations mostly deal with co- 
herent light, because our formulations for coherent light is 
easy to understand and can be extended into partially co- 
herent/incoherent light in straightforward fashion. Hence, 
in this paper we briefly mention the significance of coher- 
ence state and explain the effect on the proposed formula- 
tions. More rigorous description of coherence can be found 
in [21]. 

Throughout this paper, we consider linearly polarized 
monochromatic light in the paraxial regime for simplicity. 
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Introducing additional dimension for the wavelength eas- 
ily extends our formulations into polychromatic light. The 
paraxial approximation, a common assumption in wave- 
optics theory as well as most practical cases, simplifies 
mathematical descriptions, especially the LF transformer in 
Sec. 2.3. For more rigorous polarization analysis, matrix or 
tensor methods can be employed as in [2], We also consider 
the free-space propagation in homogenous medium and ne- 
glect any non-linear optical effect. 

As the virtual light sources and LF transformers are still 
based on ray representations, our model would have the 
same limitations as other ray-based models; if there is a 
caustic or singularity in systems, our model would not pro- 
vide accurate results. 

1.3. Related Work 

Light fields and shield fields: Light fields were proposed 
by Levoy and Hanrahan [29] and Gortler et al. [23] to char- 
acterize the propagation of rays. Several camera platforms 
have been developed for capturing light fields: Ives [26] 
and Lippman [30] used an array of pinholes. Wilburn et 
al. used camera arrays [46] and Georgiev et al. [20] put 
both prisms and lenses in front of a camera. Adelson and 
Wang [ ] and Ng et al. [33] devised plenoptic cameras 
consisting of a single lens and a lenslet array. Instead of 
the lenslet array, a sinusoidal attenuating mask was used in 
the heterodyne camera [43]. Beside the light field capture 
systems, research about light transport, cast shadows, and 
light field in frequency domain has been studied by Chai 
et al. [14], Isaksen et al. [25], and Durand et al. [18]. 
Shield fields were introduced to analyze attenuation of rays 
through occluders [28]. 

Wigner distribution function: The WDF was originally 
proposed by Wigner in quantum mechanics [45]. In optics, 
the WDF of light (electric-field) contains both the space 
and local spatial frequency information. The WDF has 
been exploited in analysis and design of various optical sys- 
tems: 3D display [19], digital holography [31, 38], general- 
ized sampling problems [ 18], and superresolution [49]. The 
WDF can also be defined for partially coherent light [6] and 
thin optical elements such as a lens, phase mask, aperture, 
or grating [5, 8, 3]. The ambiguity function, the Fourier 
transform pair of the WDF, corresponds to the LF in the fre- 
quency domain and has been used in understanding wave- 
front coding systems [13, 17]. More details of the WDF can 
be found in Ref. [7]. 

In the optics community, many researchers have tried to 
connect radiometry and wave optics. One notable concept 
is the generalized radiance suggested by Walther [44]. 
Wolf investigated extensively and summarized its physical 
meaning and limitation in [47]. In computer vision and 
graphics communities, Zhang and Levoy recently reviewed 




Figure 4: Visualization of a wavefront and its Wigner dis- 
tribution function. Rays are normal to the wavefront and 
the phase of the wavefront is equivalent to the local spatial 
frequency in the Wigner representation. 



this connection [53]. After the WDF was revealed as one 
kind of phase-space distribution functions, many different 
phase-space distribution functions have been proposed; 
angle-impact Wigner function [48] and Choi-Williams 
distribution function [16] can potentially be employed in 
developing new systems and algorithms in computer vision 
and graphics. 

Ray based model for diffraction: many different theo- 
ries have been proposed to model diffraction in the con- 
text of ray-optics. The geometrical theory of diffraction 
(GTD) is widely known [27]. To model diffraction at edge, 
the GTD exploits various laws of diffraction and computes 
diffraction coefficients. Since the augmented LF is utilized 
the WDF based on wave-optics, diffraction is automatically 
taken into account. More importantly, the augmented LF is 
implemented in the LF framework. Hence, the augmented 
LF is much more convenient than the GTD and provides 
greater versatility to researchers in computer graphics and 
vision communities. 

2. Augmented light field propagation frame- 
work 

The LF is the radiance of a ray parameterized with a po- 
sition x and angle 8. In wave optics, light is often described 
by the amplitude and phase of electric fields. The wave- 
front is defined as a surface of a constant phase in the elec- 
tric fields. The wavefront and its WDF are shown in Fig. 4. 
Rays are always normal to the wavefront and the phase of 
the wavefront is encoded in the local spatial frequency u. 
The propagation angle 9 of a ray and the local spatial fre- 
quency u is related by u — 8/ A [22], where A denotes the 
wavelength. Hence, in free-space without any light inter- 
ference, the LF representation is complete and contains the 
phase information of the wavefront. 

The Wigner distribution function for an input g(x) is de- 
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Figure 5: Comparisons of both WDF and LF for few simple 
lights. The LF and the WDF exhibit identical fashions. 



fined as 



W(s,u)= / g(x + ^)g*(x~^-)e 



-i27rux' 



dx', (1) 



where g{x) can be either electric fields or transmittance of 
an optical element. Projecting the WDF along the u-axis 
yields the intensity just as in the LF. 

Figure 5 shows wavefronts, the WDF, and the LF for a 
point source, plane wave, spherical wave, and incoherent 
light. The WDF and LF exhibit identical representations 
for these lights. Note that top three shown in Fig. 5 are co- 
herent lights and the fourth one represents incoherent light 
of lateral radiance variation. 

2.1. Limits of Light Field Analysis 

The LF is limited for elements showing diffraction 
or phase sensitive behavior (i.e., phase gratings or holo- 
graphy). To exemplify, Young's experiment (two pinholes 
illuminated by a laser) is analyzed by both the WDF and 
LF as shown in Fig. 6. In the WDF representations, the 
two point sources (from the pinholes) produce three com- 
ponents: two at the two pinholes' locations and the other at 
the middle of the two pinholes. The last component is called 
an interference term and obtained by mathematical manipu- 
lation of the WDF [11]. For infinitesimally small pinholes, 
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Figure 6: The WDF and LF representations of Young's ex- 
periment, where the third light in the WDF produces inter- 
ference. If the light is incoherent, even in the WDF, the 
third light diminishes and both representations predict no 
interference. (Color code in the WDF; red: positive, blue: 
negative) 



the transmittance of the two pinholes is given by 

g{x) = S(x — a) + S(x — b), 



(2) 



where a and b denote the locations of the pinholes. Then, 

9 y° + t) 9* \ x — t) ^ s ex P an ded as 



S (x - a + ^) + 5 (x - b + sfj 



S ( x — a 



+ 5 [x - b 



2 J 1 \ 2 

= 5{x - a)S(x') + S(x - b)5(x') 
+ 5{x-q)5(x' -p) + S(x-q)S (x' + p) , (3) 

where two new variables are defined as p = a — b and q = 
(a + b)/2. Taking the Fourier transform with respect to x' 
of eq. (3) computes the WDF of the two pinholes as 

W(x, u) = S(x - a) + 5(x - b) 

+ 26 (x- ^) cos (2tt [a - b]u) . (4) 
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As shown in eq. (4), the last cosine term oscillates between 
positive and negative values along the w-axis, thus it does 
not contribute to the intensity. In the LF description, only 
two light fields exist. As the light propagates, both the WDF 
and LF are sheared along the x-direction. The intensity of 
the fringe is computed by projection along either u or 9\ no 
interference is produced in the LF. 

If the light is incoherent, then both the WDF and LF 
representations do not have the interference term. As de- 
scribed earlier, the incoherent light is considered to be an 
infinite number of plane waves propagating along all direc- 
tions with random phase delays. If the two pinholes are 
probed by the incoherent light, then the three components 
of eq. (4) are replicated an infinite number of times with 
all possible offsets in the u-axis; the interference terms are 
averaged out. This will be clearly understood with the in- 
coherent light and the LF transformer of the two pinholes 
described in Sec. 2.3. 

2.2. Virtual light sources 

To rigorously use the LF description for diffraction 
and interference, the interference term should be included. 
Here, we expand the LF framework by introducing the con- 
cept of virtual light sources, which may have negative ra- 
diance. For the case of the two-pinholes at a and b as 
shown in Fig. 7, the location of the virtual light source is 
at (a + b)/2 and its radiance is 2 cos (2n[a — b]j) along 
the 0-axis. Since the intensity is obtained by integrating the 
augmented LF along the 0-axis, the virtual light sources do 
not affect the intensity at the pinholes plane, which agrees 
with physical observation and intuition. Once the virtual 
sources are included in the LF, then the LF propagation still 
can be used and interference can be properly modeled by 
the augmented LF. Note that, as the definition eq. (1) im- 
plies, computing the WDF of an optical element is indeed 
locating the virtual light sources for all the possible combi- 
nations of two points on the element. 

2.3. Light field transformer 

Next we model the LF propagation through an optical el- 
ement with a LF transformer. As shown in Fig. 8, in the LF 
transformer model, a thin optical element is probed by an 
input LF Li(xi, 9\), and an output LF £2(^2, #2) is gener- 
ated. In the most generalized situation, the relation of the 
input and output LFs is constructed as 

L 2 (x 2 ,6 2 ) = JJ T(x 2 , 02, xi, 9 1 )L 1 (x 1 ,9 1 )dx 1 d9 1 , 

(5) 

where T(-) denotes the LF transformer of the optical ele- 
ment. Equation (5) indicates that the optical element intro- 
duces a 4D transform (8D in the real world) from [x\, 0\) 
to (x2,9 2 ) space. 



LF with 
virtual source 

X 




L(x,9) = 5(x-a)+6(x+b) 



L(x,8) = 5(x-a)+5(x+b) 
+25(x-[a+b}/2) cos(27rA[a-6] 



Figure 7: Concept of virtual light sources for coherent light. 
In the LF representation, no interference is predicted. By 
including the virtual light sources, the LF propagation still 
can be used. 




U(x, ft) 



(a) 
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Figure 8: Angle shift invariance in a thin transparency. In 
(a) and (b), the output rays rotate in the same fashion as 
the input ray rotates, which allows that one 9 argument is 
sufficient in the LF transformer. 



For a thin optical element, x 2 
comes 



xi. Then, eq. (5) be- 



L 2 {x,9 2 ) 



T(x,9 2 ,6 1 )L 1 (x,e 1 )d9 1 



(6) 



where a 3D transform (6D in the real world) is involved. 
In most thin optical elements, they exhibit angle shift in- 
variance in the paraxial region; e.g. let us consider that an 
optical element produces three rays from an incoming ray 
of an incident angle 9\ at x\ (Fig. 8(a)). As the input ray 
rotates, the three output rays also rotate in the same manner 
as shown in Fig. 8(b). Hence, the LF transformer is suf- 
ficiently described by only one 9 argument and eq. (6) is 
further simplified as 



iMa) = Jt(x,9 1 -6 2 )L 1 (x,6 1 )d9 1 



(7) 
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Figure 9: Two more representations of free-space light 
propagation 



The LF transformer is indeed a 2D transform in the flat land 
(4D in the real world) as shown in Fig. 8(c). Equation (7) 
is particularly interesting because it involves a multiplica- 
tion along the x-axis but a convolution along the f?-axis. 
Note that the LF transformer can be computed by the WDF 
and we present the LF transformer of canonical elements in 
Sec. 4.1 and Sec. 4.2. 

When a ray passes through an optical element, if it does 
not bend and only the radiance is attenuated, and then eq. (7) 
becomes even simpler as 



L 2 (x,6) = S(x,e)Li(x,6), 



(8) 



where S(x, 9) is the shield field, describing attenuation by 
occluders [28]. 

Claim 1: At a thin interface, L^ix, 9) is expressed by a spe- 
cial operation on Li (x, 9) and a 4D LF transformer T(x, 9), 
in which the operation is a convolution along the 6>-axis and 
a multiplication along the x-axis. 

3. Propagation in Free Space 

In wave optics, the free-space propagation is described 
by the Fresnel diffraction [22]. Applying the WDF to 
the Fresnel diffraction formula, we obtain the free-space 
propagation relation in the WDF framework, which is the 
x-shear transform [7] just as the LF propagation. 

Claim 2: For the free-space propagation, the WDF and LF 
exhibit the identical x-shear transform. 

In the case of the far-zone diffraction (Fraunhofer diff- 
raction), the free-space propagation becomes the Fourier 
transform, in which the LF rotates 90°. The fractional 
Fourier transform [32, 34] describes any propagation in be- 
tween the far and near-zone more rigorously, where the 
WDF and LF both rotate by the amount of the propaga- 
tion. For all coherence states, the free-space propagation 
is identically illustrated as the x-shear transform. 
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Figure 10: Comparison of the WDF and LF of lights for 
various amplitude masks. The WDF columns represent both 
the LF transformers of the masks and the output LF with 
virtual light sources. 



4. Propagation via masks 

For a thin optical element of an amplitude mask i(x) and 
a phase mask cxp {i<f)(x)}, the LF transformer is computed 
by the WDF; applying eq. (1) to g(x) = t(x) exp {icf>(x)}. 
For convenience, we pre-computed the LF transformers of 
commonly used amplitude and phase masks in following 
sections. As described in Sec. 2.3, an incident LF interacts 
with a LF transformer, presented in Table 1 and 2, and we 
can predict an outgoing LF by eq. (7). The virtual light 
sources are automatically introduced in this transform. For 
example, for two pinholes, the third term oscillating at x = 
(a + b)/2 is the virtual light source. 

4.1. Propagation via Amplitude Masks 

Figure 10 shows some of commonly used amplitude 
masks, where the WDF column represents the WDF (or LF 
transformer) of the elements and the LF column represents 
the traditional LFs. Interestingly, the LF of a thin optical 
element is identical to the output LF when the optical ele- 
ment is probed by a plane wave propagating normal to the 
x-axis, because the LF of the plane wave is 3(9); a convo- 
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Table 1 : LF transformer of amplitude masks 



WDF LF 




Figure 1 1 : Comparison of the WDF and LF of lights for var- 
ious phase masks. The light field transformer can be easily 
computed from the transparency function A(x)e^ x \ 



lution along the 6>-axis produces the LF transformer itself. 



4.2. Propagation via Phase Masks 

We also compute the LF transformers of various phase 
masks and show in Fig. 1 1 . For optical elements with slowly 
varying phase variations whose complex transmittance is 



defined as exp {i(j>(x)}, the LF transformer is given by [9] 

r <->-«('- si)- 

This explains why the LF transformer of a cubic phase mask 
is a quadratic curve in sec. 4.2. 

5. Results 

We demonstrate how to use the LF transformer and the 
augmented LF propagation for three specific systems. 

5.1. Airy pattern in a single lens imager 

For a single lens imager shown in Fig. 12, an ideal point 
spread function is an infinitesimally small point if diffrac- 
tion is ignored. However, it is well known that the point 
spread function is indeed the Airy disk due to diffraction 
by the aperture. Here we explain how the augmented LF 
allows us modeling diffraction. 

A lens, focal length / and aperture size A, can be de- 
composed of a pure phase mask of quadratic phase varia- 
tion (i.e., quadratic change in optical path length as a func- 
tion of x) and an amplitude mask of a rectangular aperture 
as shown in Fig. 12(a). Figure 12(b) shows how the aug- 
mented LF changes throughout the system. The LF of a 
point source at x = xq is S(x — Xq) at the object plane and 
is sheared along the x-axis by the propagation to the lens. 
By the LF transformer shown in Fig. 12(a), the augmented 
LF transmitted the lens is a tilted blurb with some nega- 
tive radiance values; the quadratic phase of the lens induces 
the tilt, and the finite aperture produces radiance variations. 
Then, the augmented LF is sheared again along the x-axis 
by the second propagation to the image plane. Integrating 
the augmented LF along the (9-axis, we obtain the intensity 
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Table 2: LF transformer of phase masks 





(b) 

Figure 12: Point spread function (Airy pattern) of a single 
lens imager, (a) LF transformer of the phase and amplitude 
components of a lens with focal length /, (b) LF shape as 
the propagation through the system. Note that due to the 
finite size aperture, the PSF is the airy pattern. 

of the point spread function, which is the Airy pattern in the 
flat land. 

5.2. Wavefront coding system (Cubic phase mask) 

We apply the same procedure to a wavefront coding sys- 
tem: specifically a cubic phase mask imager for extending 
the depth of field [13, 17]. With the cubic phase mask, rays 



experience different focal lengths depending on their posi- 
tions at the mask, and they bend differently compared to 
those in the single lens imager. The cubic phase mask re- 
shapes the point spread function invariant to defocus; thus 
deconvolution in post-processing is much robust and the 
depth of field in processed images is extended. 

As shown in Fig. 13(a), the cubic phase mask imager 
has three LF transformers: a lens, rectangular aperture, and 
cubic phase mask. The LF transformer of the cubic phase 
mask is a quadratic curve. Figure 13(b) shows the system 
geometry and the behavior of the LF through the system. 
Again we start with a point object and the LF is sheared 
along the .T-axis by the propagation to the lens. By the lens 
and the cubic phase mask, the transformed LF becomes a 
curved blurb. After the second propagation, the augmented 
LF is transported at the image plane. Since the LF is not 
parallel to the #-axis, the point spread function is distorted 
and has asymmetric tails. 

If an object is defocused, then the LF of the object at the 
focus plane is not parallel to the #-axis and is rather tilted. 
This sheared input LF also causes the sheared output LF 
at the image plane in the x-direction; however, the inten- 
sity does not change significantly because the contributions 
from the upper and lower parts of the curved LF are com- 
pensated with each other. In the original derivations of the 
extended depth of field by using the cubic phase mask [17, 
13], the ambiguity function was exploited to represent the 
OTF for various defocus simultaneously. Finally we want 
to mention that various phase masks have been analyzed for 
the extended depth of field [12, 35, 10, 36, 50, 52, 51, 4]. 

5.3. Hologram Transform of Light Field 

In this section, given the LF transformer of a hologram, 
we show how to predict an output image. For simplicity, 
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Figure 13: Point spread function of the cubic phase mask 
imager, (a) LF transformer of a lens and cubic phase mask, 
(b) LF shape as the propagation through the system. Note 
that the PSF is distorted but invariant to defocus. 
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we choose a point source as an object. Thus, a spherical 
wave from the point source is an object wave, and a plane 
wave propagating parallel to the optical axis is a reference 
wave as shown in Fig. 14(a). To obtain the LF transformer 
of the hologram, we first compute the transmittance of the 
hologram, which is proportional to the intensity of the in- 
terference between the object and reference waves. From 
the geometry, the electric field of the reference and object 
waves in the paraxial region are given by 



i^z 



E r (x,y, z) = cxp {,- 
E a (x,y,z) 



} , and 



exp {if(z + d)+^} 



The intensity of the interference is proportional to 

I ~ E*E Q + E r E*. 



(10) 
(11) 

(12) 



Here we ignored DC terms, \E r \ 2 and \E a \ 2 , because they 
are uniform and do not contain high frequency signals. By 
substituting eqs. (10) and (11) with eq. (12) and using z = 
(hologram is at z = 0), the transmittance of the hologram is 
proportional to 



/ ~ exp 



, r ex P 



' 2nx 2 } 



exp ■ 



-^1 



exp 



—i 



27T^ 

A 2d 



(13) 



Figure 14: Light field-based reconstruction from hologram 
of a single Lambertian scene point. (Left in (a)) Record- 
ing geometry, and (Right in (a)) the LF transformer of the 
recorded hologram. (Top in (b)) Reconstructing hologram 
with the reference wave. Two diffracted lights are produced 
at z = and z = d. (Bottom left in (b)) the LF at z = 0, 
(Bottom right in (b)) the LF at z = d. 



Now we compute the WDF of eq. (13) as 



W(x,u) = S [u- — 
\d 



2 cos 



2tt 
T 



2d 



x 
~d 



d\ 2 u 2 



(14) 



where we have not shown the last cosine term in Fig. 14 
because it is a higher order oscillation term spread over the 
entire x-9 space. Finally, the LF transformer of the holo- 
gram is 



T(x, 0) 



x 
d 

,'2ir 
I — 



2d+ X — 
d 



d0 A 



(15) 



In the reconstruction, the replica of the reference wave 
probes the hologram. Since the LF of the reference wave 
is 6(8), the LF of the reconstructed wave is shown in the 
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bottom left of Fig. 14(b). Behind the hologram, at z > 0, 
two waves are produced: 1) a converging spherical wave, 
which is focused at z = d, and 2) a diverging spherical 
wave, which looks like originating from a point object at 
z = — d. If an observer looks at the hologram from the other 
side of the original point object from any distance (z > 0), 
the diverging spherical wave produces a virtual image of the 
original point object. If a screen is placed at z = d, one will 
also observe a real image. Note that the two components in 
the LF transformer of the hologram correspond to the virtual 
and real images as shown in the right panel of Fig. 14(a). 

Here we simplified the holography extremely. In prac- 
tice, since coherent light is used in both recording and re- 
construction, the high-order oscillation terms, often called 
cross-terms or interference terms in the optics community, 
should be considered as well. More rigorous analysis of 
holography with the WDF can be found in [37, 42]. 

6. Conclusion 

Geometrical optics, commonly used in computer vision, 
and wave optics, used in diffraction and interference anal- 
ysis, employ different formulations. Yet they describe the 
same propagation of light in different contexts. There are 
many interesting complementary concepts in these two ar- 
eas; e.g., the Shack-Hartmann sensor for sensing aberra- 
tions in a wavefront, is an identical concept and uses the 
same optics as the plenoptic cameras detect radiance along 
different angles. The similarity of the LF and the WDF 
could be one of the most fascinating connections between 
computer vision/graphics and optics communities. 

Whereas the LF describes many optical phenomena well, 
it is limited to incoherent light and inadequate to describe 
diffraction and phase-sensitive optical elements. In this 
paper, we employed wave optics to broaden the scope of 
the LF and the augmented LF can model diffraction and 
interference. For the free-space propagation, the LF and 
the WDF exhibit the same x-shear transform. To account 
for diffraction due to either amplitude or phase variations, 
we introduced the concept of the virtual light sources with 
varying, possibly negative, radiance along different angles. 
Once the virtual light sources are included properly in the 
augmented LF framework, one can continue to use the LF 
propagation in any optical systems. We also introduced the 
concept of the LF transformer, which describes the rela- 
tion between the input and output LF for optical elements. 
We assumed a thin transparency and angle shift-invariance, 
which is true for most conventional optical elements, the LF 
transformer is represented by a 2D lookup table in the flat 
land. We pre-computed the 2D lookup tables for canonical 
optical elements such as an aperture, a lens, gratings, and 
various phase masks. Since these results already include 
the virtual sources, we are able to extend the LF framework 
under diffraction and phase-sensitive elements. The bene- 



fit is that optical systems previously considered beyond the 
analysis abilities of the LF, such as phase masks and holo- 
grams, can now be used in computer vision and graphics 
applications with simple modifications. 

Although our examples are described with coherent 
light, incoherent or partially coherent light are much more 
interest; because the WDF is more powerful for incoher- 
ent and partially coherent than for coherent light [15, 41]. 
Moreover, most applications in computer vision and graph- 
ics deal with partially coherent and incoherent light. As we 
described earlier, the augmented LF can be extended into 
partially coherent as well as incoherent light. 

There are several future directions of exploration. One 
obvious application is rendering. Since the proposed for- 
mulation can incorporate geometrical characteristics with 
wave property of light, it would provide more realistic ren- 
dering results for surfaces involving diffraction and inter- 
ference [39, 24, 40]. Compared to wave optics, geometric 
optics assumes infinitely small wavelengths. We can create 
a continuum of solutions for the LF when this assumption 
is not valid. One can derive the LF transformer equation 
from the WDF by assuming infinitely small wavelengths. 
In the rectangular aperture shown in Fig. 10, as the wave- 
length decreases, the WDF of the aperture is squeezed down 
along the u-axis and it eventually becomes 6(0)iect(x/A). 
We would also like to explore the LF transformers beyond 
thin transparencies or occluders with angle shift invariance. 
Other manipulations will include volumetric objects with 
6D or 8D transforms that will result in 3D or 4D lookup 
tables for optical elements. 

Finally our goal is not only to introduce WDF to the 
computer vision and graphics communities but also to sup- 
port more rigorous analysis of augmented light field that 
could lead to a new class of applications. We hope this work 
will inspire researchers in optics as well as in computer vi- 
sion/graphics to develop new tools and algorithms based on 
joint exploration of geometric and wave optics concepts; 
e.g., utilizing useful concepts and techniques from wave op- 
tics brought more realistic results and different data repre- 
sentation to computer graphics applications [54, 55]. 
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